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c| ■ Abstract 
-i— > 

We study goodness-of-fit testing for non-causal autoregressive time series 
with non-Gaussian stable noise. To model time series exhibiting sharp spikes 
or occasional bursts of outlying observations, the exponent of the non-Gaussian 



■ stable variables is assumed to be less than two. Under such conditions, the 

. innovation variables have no finite second moment. We proved that the sample 

o; 

, autocorrelation functions of the trimmed residuals are asymptotically normal. 

Nonparametric tests are also investigated. The rank correlations of the residuals 



^ ■ or the squared residuals are shown to be asymptotically normal. Thus, an 

assortment of portmanteau statistics are available for model assessment. 
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1 Introduction 



Infinite variance autoregressive (AR) time series models have various practical appli- 
cations. For example, Resnick (1997) fitted such a model to interarrival times between 
packet transmissions on a computer network, Gallagher (2001) studied differenced sea 
surface temperatures and fitted a symmetric a-stable AR model, and Ling (2005) ex- 
amined the daily log- returns of the Hang Seng Index in the Hong Kong stock market. 
When modeling infinite variance autoregressive processes, non-Gaussian a-stable dis- 
tributions (i.e. the exponent parameter a < 2) are often adopted to specify the 
innovation process due to their intriguing mathematical properties. This rich class 
of probability distributions allows heavy tails and skewness, the features exhibited in 
many observed time series including signal processing in electrical engineering Stuck 
and Kleiner (1974); Sheng and Chen (2011), portfolio selection Rachev et al. (2004), 
and asset allocation Tokat and Schwartz (2002). So, the use of a-stable AR models 
is well justified both theoretically and empirically. 

When studying AR processes, causality (all roots of AR polynomial are outside the 
unit circle) is conventionally assumed. However, such an assumption is only needed 
when the study is carried out within the classical Gaussian framework in order to 
ensure the identifiability of model parameters. Indeed, for every non-causal Gaussian 
AR process there exists an equivalent causal representation in the sense that the 
two processes have the same mean and autocorrelation functions (see Brockwell and 
Davis (1991)). Since a Gaussian distribution is uniquely determined by its first two 
moments, the two processes necessarily possess the identical probability structure and 
hence are indistinguishable. In contrast, under a non-Gaussian setting, a non-causal 
AR process will have a different probability structure than its causal representation. 
In other words, for a non-Gaussian AR process the model parameters are identifiable 
and the model can be configured uniquely without being confined to the causal case; 
see Breidt and Davis (1992) and Rosenblatt (2000). 
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In this work we consider diagnostic tests for non-Gaussian non-causal a-stable 
AR processes. We remove the assumption of causality and refer to such processes 
as general AR processes. There has been a certain amount of work in the literature 
on general AR processes. For example, Breidt et al. (1991) discussed a maximum 
likelihood procedure for parameter estimation for autoregressive processes with non- 
Gaussian innovations. Andrews et al. (2009) studied maximum likelihood estimation 
for general AR processes with non-Gaussian a-stable innovations. They showed that, 
when fitting trading volumes of the Wal-Mart stock, a general model yielded a better 
description of the observed data in the sense that the residuals are more compatible 
with the assumption of independent innovations than the residuals produced by its 
causal representation. Lanne et al. (2010) considered forecasting of the non-causal AR 
time series and demonstrated the improvements in the change-of-direction forecasts 
when relaxing causality in the AR model fitted to the US inflation series. Recently 
Andrews and Davis (2011) developed a procedure of model identification for infinite 
variance AR processes and showed that minimizing Gaussian-based AIC yields a 
consistent estimator of the AR order. 

Compared to the devotions received to parameter estimation and model identifi- 
cation for infinite variance non-causal AR processes, model diagnostics have not been 
fully addressed so far. This work intends to fill the gap. Utilizing the recent results 
of Lee and Ng (2010) and Bouhaddioui and Ghoudi (2012) we develop portmanteau 
test procedures for checking the goodness-of-fit of the non-causal a-stable AR model, 
where the model parameters are fit using maximum likelihood estimation. As second 
moments do not exist for infinite variance models, the behavior of the sample auto- 
correlation of the residuals from the fitted model is hard to harness for the purpose of 
model diagnostics. To circumvent the difficulty, we propose to use the trimmed resid- 
uals or nonparametric procedures based on the ranks of the residuals or the squared 
residuals. We show that the sample autocorrelation of trimmed residuals at a given 
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lag for fitted general AR processes is asymptotically normal and hence the commonly 
used portmanteau tests in the classical Gaussian framework that are based on sam- 
ple ACF, such as Box and Pierce (1970) and Ljung and Box (1978), can be easily 
extended to an infinite variance setting. We also proved that the rank correlations of 
the residuals or the squared residuals are asymptotically normal. Thus nonparametric 
tests could also be developed for model diagnostic purpose. 

The rest of the paper is organized as follows. In section 2, we introduce the neces- 
sary background material to derive the asymptotic distribution of trimmed residuals. 
We then discuss the use of nonparametric and propose nonparametric methods. Using 
the asymptotic properties we propose an assortment of portmanteau test based on 
the classical methods and recent results. In section 3, we examine the finite sample 
performance of the proposed procedures through simulation studies. We check and 
compare the empirical sizes and powers of the tests. All technical proofs are relegated 
to the Appendix. 

2 Theoretical Results 
2.1 Preliminaries 

Let {Y t } be the autoregressive process satisfying the stochastic difference equation 

<P(B)Y t = Z t , (1) 

where the AR characteristic polynomial has no zeros on the units circle, <p(z) := 
1 — 4>iz — ■ ■ ■ — cf) p z p 7^ for \z\ = 1, and the i.i.d innovation variables {Z t } have a 
stable distribution with exponent a G (0,2). We also assume that the AR charac- 
teristic polynomial could be written as the product of causal and purely non-causal 
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polynomials, 



^ = (i - e lZ e r z r ){i - e r+1 z e r+sZ s ). 

oo 

Then the unique strictly stationary solution to (CQ) is given by Y t = ipjZt-j, where 



j=-oo 



Z 1 



ipj's are determined by the Laurent series expansion for l/(p(z), l/<f>(z) = ip 

j=-oo 

It is well known that the coefficients are geometrically decaying; namely there 
exist C\ > and < D\ < 1 such that < C\D^ for all j. Now let ipj = ip-j, for 
j > 0. We rewrite the solution to ([I]) as 

oo oo 

« ■ • E^w ( 2 ) 

j=0 j=l 

For the AR model defined in ([T]), let cf> be the MLE estimator by Andrews et 
al. (2009). Then n l / a {(j) - <j>) 4 S, where S is some random variable. It could 
be shown that there exists 5, satisfying 2a/ (2 + a) < 5 < min(a, 1), such that 
n- 1 /" = o(n- 1 /*+ 1 / 2 ). 

Suppose the observed time series is represented as {Y_ p+1 , ■ ■ ■ , Y , Y 1: ■ ■ ■ , Y n }. 
Then the residuals of the fitted model, {Z t }" =l , are given by 

z t = Y t - to.! p F t _ p . (3) 

Let {Zt}t=i be the residuals of the fitted model. For some predetermined lower 
percentile X L and upper percentile X u , let M% and be the (n\ L )-th and (nA f/ )-th 
order statistics of {Z t }t =l , respectively. We define the following trimmed residuals 

f t = Z t I [Ai<2t< Mu y 

The goal is to test the hypotheses where the null (H ) is that the ARMA model 
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([I]) with s > is adequately identified. For the trimmed residuals, the sample auto- 
correlation at lag k, p k , is computed by the formula 

~ = EU+i nh-k) - (E?=fc+i n) (EjU+i f t-k) /(n-k) 

Theorem 1. // the model £7]] correctly identified by the MLE method, then, for 
any positive integer m, we have 



where p~r m \ := (p%, . . . , p m ) T and I m is the m x m identity matrix 

The sample partial autocorrelation (PACF) at lag k, n k , can be derived by Durbin- 
Levison algorithm: 

p k - p {k _ 1) R~ {k _ 1) p\ k _ t) 
nk = — ^ — p -i : > ( 5 ) 

where p (A ,_ 1} = (p\, . . . , p fc _i) T , R( k -i) = (p\i-j\)ij=i (i.e. the symmetric Toeplitz 
matrix generated by (1, p h . . . , p k -i)), and p* fc _ 1) = (pVi, . . . , pi) T . 

Theorem 2. // i/ie model (QJj 2S correctly identified by the MLE method, then, for 
any positive integer m, we have 

yfrm (m) 4 JV(0,I m ), 

where Ttt m ) : = (ttx, . . . , vr m ) T and I TO is the m x m identity matrix 

Nonparametric portmanteau tests could also be developed. The following result 
provides the foundation for nonparametric tests based on the empirical process of the 
residuals or the squared residuals. Let fj = EILiH^* — Zj}/n be the normalized 
rank of Zj and define the rank correlation as % = E™=i(^* ~ V^)(^*+« — V^)- We can 
also define the rank correlations for the squared residuals, 7*, in the same fashion. 
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Theorem 3. If the model (QJ) is correctly identified by MLE method, then, for any 
positive integer m, we have 

12V^y H 4jV(0,I m ) 
12v^7( m) 4iV(0,I m ) 

where 7 {m) := (71, . . . , 7 m ) T , 7( m) := (7*,...,7^) T and I m is the m x m identity 
matrix. 

□ 

2.2 Goodness-of-fit testing 

The results of Theorems [IJ [2] and [3] allow for the construction of the so called Port- 
manteau Statistics for time series goodness-of-fit. A Box and Pierce (1970) or Ljung 
and Box (1978) type statistic can be constructed, consider: 

m 

Q eb {m) = n{n + 2) V (6) 

n — k 

k=l 

Under the null hypothesis, the Ljung Box type statistic will behave as a chi-square 
random variable with m degrees of freedom. 

A statistic inspired by Monti (1994) can be constructed utilizing the partial au- 
tocorrelation function of trimmed residuals and Theorem |2j 

Q mt (m) = n(n + 2) V (7) 
z — ' n — k 

k=l 

will be asymptotically distributed as a chi-square random variable with m degrees of 
freedom for a given positive integer m. 

Recent work in the literature has suggested asymmetric statistics may be more 
powerful in some situations than the symmetric (i.e. equally weighted) Ljung Box 
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and Monti type statistics. Define R m as the Toeplitz matrix of autocorrelations: 



Rn 



1 Pi • • • Pm 
Pi 1 • • • Pm-1 

Pin Pm—1 ■ ■ ■ 1 

Pena and Rodriguez (2002) suggest a statistics based on the likelihood ratio test from 
multivariate analysis. Their statistic is D = n(l — |i? m | 1//m ). Utilizing the asymptotic 
normality from Theorem [2] and an application of the delta-method, the asymptotic 
distribution under the null hypothesis can be shown to satisfy 



m — k + 1 2 
■Xk 



k=l 



m 



where each \\ is a chi-square random variable with one degree of freedom. This 
distribution is difficult to write explicitly but can be well approximated by a Gamma 
distribution; see Pena and Rodriguez (2002) for details. 

In Pena and Rodriguez (2006) they suggest the sum of the log of one minus the 
squared partial autocorrelation function. Utilizing Theorem 2, that statistic can also 
be shown to satisfy ©. Mahdi and McLeod (2012) generalize the result of Pena and 
Rodriguez (2002, 2006) to the multivariate time series setting. In the univariate case 
their statistic is 



Q gv (m) 



—3n 



\og\R r , 



(9) 



2m + 1 

and the distribution follows a result similar to (jSJ) and can be approximated with a 
chi-square with (3/2)m(m + l)/(2m + 1) degrees of freedom. 

Recently, Fisher and Gallagher (2012) suggest an alternative asymmetric test 
compared to those based on the determinant of the matrix R m . They suggest a 
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Weighted Ljung Box 

(m )=n(n + 2 V ^- 10 

z — 4 m n — k 

k=l 

which is shown to satisfy the distribution in ([8]) and can be well approximated by 
a Gamma random variable with shape a = 3m(m + l)/(8m + 4) and scale (3 = 
2(2m + l)/3m. Likewise, a Weighted Monti statistic is also introduced that follows 
the same asymptotic distribution under the null hypothesis. 

3 Simulation Studies 

Computation on a-stable distributions has been well studied and is known to be 
computationally difficult. Our studies were performed in the GNU-licensed R-Project 
utilizing the stable distribution in the stabledist package with parameterization 
method zero. Due to the computational intensity in optimizing the likelihood function 
in Andrews et al. (2009), much of our studies were run in a parallel framework 
utilizing the multicore package. Similar to Andrews et al. (2009), when optimizing 
the likelihood function we generate 1200 random initial conditions; the likelihood 
function is found for each, and then the Nelder-Mead optimization routine is run on 
the best eight. The parameters for maximum likelihood function of those eight is 
chosen as the MLE for the general AR process with a-stable innovations. Since the 
maximum likelihood function is found we can easily calculate the model identification 
criterion from Andrews and Davis (2011) as well. 

In our studies we compare the Ljung Box type statistic in ([6]), the Monti type 
in ([7]), the Mahdi McLeod type in (Q, the corresponding Weighted version of Box- 
Pierce Q w b, Monti bype Q wm , and Ljung Box test Q w g in ( flOl) and the nonparametric 
test Q r k = 144n YlT=i ^1 f° r the residuals and Q r k s = 144n Y^k=i(%) 2 f° r the squared 
residuals. The Mahdi McLeod was chosen over the suggestions in Pena and Rodriguez 
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(2002, 2006) since it is numerically stable (see Lin and McLeod (2006)), has conser- 
vative Type I error performance and is implemented in the portes package. The 
statistics from Fisher and Gallagher (2012) are available in the WeightedPortTest 
package and include unweighted versions as well; i.e. the traditional Ljung Box and 
Monti types. When trimming the residuals, we truncate at the first and 99th per- 
centiles. 

We check the finite sample sizes and powers of the proposed tests for different 
AR(1) and AR(2) models. For each selected model the simulation is run 1000 times. 
The results are summarized in Table 1 through Table 3. Overall, these tests perform 
well when a > 1.5. No test dominate the performance. As a decreases the empirical 
sizes increase. But since in practice the a for the fitted model is always above 1.5, 
the problem does not cause big concerns to us. 

4 Appendix 

To prove Theorem 1, we follow the method used in Lee and Ng (2010). Since Propo- 
sition 5.2 is true for the innovation process in general, we can use it for free. The 
key is to establish the remaining technical lemmas in their paper for the non-causal 
model. In the following, Proposition 1 and 2 are corresponding to Proposition 5.1 
and 5.3 of Lee and Ng respectively. 

Let <pt = Z t — Z t , for t = 1, • • • , n. From (j2j) we get 

p p oo p oo 

<pt = ^{<t>j - h) Y t-j = - fa) Yl faZt-j-k + J2(4>j - fa) Yl ^Zt- J+ k (ii) 

j=l j=l fc=0 3=1 fe=l 

By changing the order of summation 
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Table 1: Empirical sizes of non-causal AR(2) model with s=l, n=500 



AR(2) 
1= 2.8 02 = -1.6 


Qrnt Qrk Qgv Qrks 


Qwb Qwi Qwm 


a = 1.8 5 
= 10 
7 = 1 15 
5 = 20 
25 


0.042 0.045 0.030 0.020 0.051 
0.050 0.049 0.035 0.020 0.034 
0.045 0.049 0.035 0.018 0.039 
0.043 0.045 0.034 0.017 0.039 
0.042 0.054 0.038 0.014 0.047 


0.034 0.036 0.037 
0.035 0.039 0.040 
0.046 0.050 0.046 
0.049 0.056 0.049 
0.039 0.052 0.048 


a = 1.5 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.032 0.029 0.030 0.031 0.043 
0.044 0.046 0.032 0.023 0.041 
0.045 0.044 0.024 0.020 0.038 
0.048 0.048 0.039 0.016 0.041 
0.039 0.046 0.037 0.015 0.046 


0.030 0.031 0.034 
0.032 0.034 0.036 
0.036 0.039 0.042 
0.038 0.042 0.042 
0.034 0.043 0.047 


a = 1.2 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.059 0.062 0.059 0.037 0.059 
0.060 0.056 0.062 0.029 0.062 
0.056 0.055 0.059 0.025 0.052 
0.049 0.053 0.067 0.021 0.057 
0.050 0.062 0.061 0.018 0.059 


0.052 0.050 0.053 
0.057 0.061 0.056 
0.057 0.062 0.058 
0.057 0.060 0.056 
0.054 0.059 0.059 


a = 0.8 5 
/3 = 10 
7 = 1 15 
5 = 20 
25 


0.088 0.083 0.073 0.068 0.087 
0.078 0.081 0.085 0.053 0.069 
0.081 0.084 0.078 0.047 0.071 
0.086 0.080 0.074 0.048 0.068 
0.083 0.078 0.071 0.046 0.063 


0.084 0.087 0.086 
0.088 0.091 0.088 
0.087 0.091 0.092 
0.079 0.085 0.084 
0.074 0.082 0.080 


a = 1.8 5 
(3 = 0.5 10 
7 = 1 15 
5 = 20 
25 


0.045 0.045 0.038 0.022 0.041 
0.046 0.047 0.034 0.017 0.039 
0.042 0.040 0.040 0.019 0.040 
0.046 0.039 0.037 0.014 0.046 
0.045 0.044 0.035 0.015 0.044 


0.030 0.030 0.029 
0.043 0.044 0.044 
0.041 0.043 0.042 
0.037 0.042 0.041 
0.033 0.040 0.039 


a = 1.5 5 
= 0.5 10 
7 = 1 15 
5 = 20 
25 


0.048 0.043 0.037 0.036 0.044 
0.038 0.043 0.031 0.032 0.033 
0.042 0.040 0.042 0.034 0.035 
0.036 0.044 0.035 0.034 0.034 
0.035 0.033 0.030 0.034 0.036 


0.039 0.041 0.042 
0.034 0.038 0.037 
0.038 0.042 0.034 
0.035 0.036 0.036 
0.031 0.037 0.036 


a = 1.2 5 
(3 = 0.5 10 
7 = 1 15 
5 = 20 
25 


0.066 0.063 0.047 0.054 0.069 
0.061 0.066 0.045 0.066 0.064 
0.063 0.070 0.040 0.070 0.064 
0.06 0.075 0.053 0.075 0.062 
0.06 0.061 0.054 0.076 0.056 


0.062 0.064 0.060 
0.062 0.064 0.061 
0.064 0.069 0.063 
0.065 0.067 0.065 
0.065 0.068 0.064 


a = 0.8 5 
/3 = 0.5 10 
7 = 1 15 
5 = 20 
25 


0.099 0.104 0.098 0.043 0.094 
0.114 0.113 0.091 0.047 0.083 
0.115 0.110 0.098 0.053 0.079 
0.105 0.102 0.094 0.059 0.073 
0.108 0.115 0.087 0.060 0.071 


0.099 0.100 0.102 
0.115 0.117 0.115 
0.104 0.109 0.115 
0.103 0.110 0.109 
0.095 0.105 0.109 
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Table 2: Empirical powers for non-causal AR(2) model fitted as non-causal AR(1), n=50 



AR(2) 

0! = -1.2 02 = 1-6 


Qffi Qmt Qgv Qwb Qrk 


a = 0.8 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.616 0.541 0.67 0.756 0.915 
0.483 0.325 0.523 0.629 0.833 
0.397 0.246 0.420 0.574 0.752 
0.373 0.167 0.326 0.538 0.693 
0.356 0.135 0.258 0.504 0.623 


a = 1.2 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.533 0.454 0.550 0.633 0.684 
0.425 0.311 0.446 0.556 0.550 
0.381 0.219 0.349 0.509 0.462 
0.376 0.167 0.276 0.487 0.404 
0.349 0.117 0.204 0.460 0.360 


ct = 1.5 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.426 0.358 0.428 0.497 0.456 
0.323 0.241 0.335 0.447 0.343 
0.302 0.174 0.262 0.407 0.264 
0.284 0.138 0.192 0.379 0.227 
0.311 0.107 0.145 0.361 0.178 


a = 1.8 5 
(3 = 10 
7 = 1 15 
5 = 20 
25 


0.313 0.263 0.305 0.362 0.323 
0.235 0.188 0.247 0.319 0.214 
0.228 0.145 0.193 0.296 0.155 
0.230 0.115 0.142 0.275 0.116 
0.246 0.092 0.094 0.282 0.095 
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Table 3: Empirical powers for non-causal AR(2) model fitted as non-causal AR(1), n=75 





AR(2) 














01 = 


= -1.2 02 


= 1.6 


Qlb 


Qmt 


Qgv 


Qwb 


Qrk 


a - 


= 0.8 


5 


0.909 


0.851 


0.933 


0.948 


0.99 




= 


10 


0.692 


0.591 


0.853 


0.905 


0.973 


7 


= 1 


15 


0.601 


0.447 


0.723 


0.801 


0.954 


S 


= 


20 


0.554 


0.351 


0.617 


0.727 


0.935 






25 


0.492 


0.296 


0.547 


0.687 


0.900 


a - 


= 1.2 


5 


0.831 


0.791 


0.868 


0.873 


0.911 


(3 


= 


10 


0.678 


0.583 


0.783 


0.833 


0.829 


7 


= 1 


15 


0.598 


0.470 


0.694 


0.776 


0.770 


S 


= 


20 


0.568 


0.377 


0.608 


0.732 


0.729 






25 


0.533 


0.312 


0.537 


0.694 


0.673 


a - 


= 1.5 


5 


0.727 


0.692 


0.744 


0.772 


0.785 





= 


10 


0.606 


0.528 


0.689 


0.742 


0.657 


7 


= 1 


15 


0.537 


0.422 


0.617 


0.687 


0.580 


5 


= 


20 


0.506 


0.344 


0.541 


0.658 


0.522 






25 


0.492 


0.277 


0.469 


0.635 


0.464 


a - 


= 1.8 


5 


0.554 


0.519 


0.586 


0.618 


0.628 





= 


10 


0.470 


0.420 


0.521 


0.586 


0.485 


7 


= 1 


15 


0.421 


0.339 


0.470 


0.545 


0.394 


5 


= 


20 


0.413 


0.285 


0.408 


0.522 


0.343 






25 


0.389 


0.240 


0.343 


0.507 


0.288 
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and 



p oo 

j=l k=0 j=l k=l 

oo min(j,p) 

s E E 

j=l k=l 



oo min(j,p) 
< I ^2 Y 4>k)^j-kZ t - 3 



\ipj-k\\Zt 



t-j i > 



(12) 



p oo 

j=l k=l 

oo p p—lp 

< 1 ~~ <t>k)i>j+kZ t +j\ + 1 E E 

j=0 A;=l j=l k=j+l 

oo p p—lp 

-EE||^~^ i^+fe^t+ji + Xl E ||^ 

j=0 fc=l j=l k=j+l 



$ k )i\) k -jZ t -j\ 

Itpk-jZt-j], 



(13) 



where — is the Euclidean distance of and 0. By Andrews and Davis (2009) 
the MLE estimator of the AR polynomial coefficients, 0, converges to some random 
variable in distribution S\ By our assumption that < a < 2, we 

can find a 5 with 2a/ '(a + 2) < 5 < min{a, 1} such that n~ a = oipT 1 ^ 6 ^' 2 ). Note 
that for any given e > there always exists a 71 > such that P(|5*| > 71) < e/2. 
If we define define A n = j — < 7 1 r?r 1 / a j then there exists N > such that 
P(A n ) > 1 — e whenever n > N\. Under the condition of A n , we can obtain an upper 
bound for (JT2} 

p 00 00 min(j,p) 

lX>;-&)X>*Zt- fc | <7i^ 1/Q E E lV>i-*ll^il. ( 14 ) 

j=l j=0 j=l fc=l 



and an upper bound for (Q3 
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p oo oo p p— 1 p 

E^^E^^I <7i^ 1/Q ^^l^ +fc ||^ +J l+7in- 1/a X] E Itk-jWZt-il 

j=l k=l j=0 k=l j=l k=j+l 

(15) 

mm(jr',p) p p 

Let V) = E = E l^'+ fc l' and $h-j> = E 

fc=l fc=l k=l 

Assuming A n is true, an upper bound for \<p t \ is given by 



oo oo p— 1 

N < Tr^E^-il +Tin- 1/a ^^|^tfil + 7in~ 1/a X)^V" > pl^t-il- ( 16 ) 

3=1 5=0 3=1 

Proposition 1. For / f7^) . t/ie following are true, 

oo 

E\Y,r 3 \z t ^\\ 5 < oo, 

i=o 

n oo oo 

t=l j=l j=0 

Proof. The coefficients {V'j} and {ijjj} are geometrically decaying as j — > oo. As a 

oo oo 

result, l^jl 5 < oo and < oo. 

3=1 i=i 
Change the order of summation and apply the triangle inequality, then we have 

oo oo min(j,p) oo 

Ewi^E E i^i 5 =pEi^'| 5<o °' 

3=1 3=1 fc=l 3=0 

and 



oo oo p oo 

E ^ E E \^\ 5 <pJ2\^\ 5 < °°- 

j=0 i=0 fc=l j=l 

Also by the triangle inequality (for example, page 537, Brockwell and Davis, 1991) 
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and E\Z t -j\ s < oo 



oo 



E\ Y^^Zt-iW 5 < E\Y,W\*\\Zt-j\ S <°o, 

j=l 3=1 



oo oo 



E\J2^\Zt +3 \\ S < E\Y,Wj\ 5 \\Z t+j \ 5 <oo. 

3=0 3=0 



□ 

Given a fixed number < A < 1 and f3 n a predetermined sequence of real numbers, 
let xt — Z t — Z({ n x\) — j3 n . The Proposition 5.3. of Lee and Ng (2010) is also true for 
the non-causal AR sequences. 

Proposition 2. For any 72 > ; 

n 

Pin' 1 / 2 l(|vt|>|xt|)U, > 72} 0. 
t=\ 

Proof. As in Lee and Ng (2010), we can pick a constant 73 > such that P(|Z s [ nA ]| > 
73) is arbitrarily small in which s(k) = j if Zj is the k th largest number among 
{Zi, . . . , Z n }. To show the result it is sufficient to get 

n 

> |x*l) n4n (\z s[nX] \ < 73 )} = o(n x / 2 ). 

t=\ 

By Lee and Ng (2010), for any t e {1, . . . , n}, 
P{(|^| > \ Xt \)nA n n(\Z s[nX] \ < 73)} < V^^{k t | 5 lx t r 5 i ( |z s[ „ A] i< 73 )iA n t ? s([n\})}. 

lb lb 
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Use triangle inequality and ( IT6|) 



t=i 



n oo 
n oo 



j=0 

p-i 



s ([nA])^t}+ 
s([nA])^f}+ 

s([nA])^f}- 



(17) 
(18) 
(19) 



To finish the proof, in the next we will show (ITT)) . (ITBl . and (TT9)) are o(n 1 / 2 ). 
Conditional on s([nA]) — t — j and s([nA]) ^ t — j, (ITT)) is bounded above by 



-5 



s ([nA])^t}+ (20) 
S ([nA])^0- (21) 



t=i 



We apply Proposition 1, (5.23) in Proposition 5.3 of Lee and Ng (2010), and the fact 
that n' 1 ^ = o(n- 1/<5+1/2 ) to fl20)) and get 



3=1 



s ([n\}) ^t} = o(n 1/2 ). 



For ( )2Tj) . two cases, 1 < j < t — 1 and j > t, are considered respectively. When 
1 < J < t - 1, 



t-i 



n — 2 



i=i 



^ «} < 



t=i 



3=1 



a([nA])^t,t-j} = o(n 1 / 2 ) 
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t-1 



s{[n\}) + t,t-j} 



since by (5.22) of Lee and Ng (2010) E{J2\*Pj\ 5 \ z t-j\ S \Xt\~ 

3=1 

0(1). When j > t, Z t _j is in the set {Z , Z_i, . . .}. Hence, Z t _j is independent of 
s([nA]), which implies that 



E{\^\ S \Z t . 3 \ s \xt\- 5 l {s[ nX^t- 3 ) 



s([n\}) ^t} = \rA 5 E{\Z t ^\ s }E{\ Xt \-% [nX] ^ 



■3) 



s([n\])^t}. 



Now use Proposition 1 and (5.23) of Lee and Ng again 



t=l j=t 

n -. oo 

n — 1 



s([n\})^t}< 



-6/a'_ 



t=l 



n 



J2 ir/EilZ^/jEilxr 5 !^^) s([nX}) ^t} = o {n 1 ' 2 ) 



3=t 



Therefore, (JTTJ) is o^n 1 ^ 2 ) . In the same way, the result also holds for ( Tl8l) and ( fl9l . 

□ 

Proof, of Theorem [TJ 

Let q L and q u be the (A L )-th and (\ u )-th quantiles of Z t . Denote the mean and 
standard deviation of the trimmed random variable Z t I(q L < Z t < q u ) by /i and <r, 



(M = E[Z t I(q L < Z t <q u )} and a 1 = Var[Z t I(q L < Z t < q u )]. 



u \ 



Let Z% = Z t I t — /i, then directly from Lemma 4.1 in Lee and Ng (2010), 



n 



n 



n 



-1/2 



t-k 



D 



AiV(0,cr 4 / m ), 



-1/2 \ " — I-> 



k=l,2,...,m 
2\ 



t=l 



(22) 



t=i 
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with k being certain constant associated with the distribution of Z t , and {q L ,q u )- 

Now let M% and be the (nA L )-th and (nA c/ )-th order statistics of {Z t }? =1 and 
define Zj* = Z t h — £t an d 



1, \iM^<Z t <M^ f = J 1 ' ir V/ ' < Z < < U ' - 

0, otherwise, 0, otherwise. 



It follows from Proposition (TjQ), Proposition (j2J), and the proof of Lemma 4.2 in Lee 
and Ng (2010) that 



^ \ Z t Z t-k - % Z U\ 4 0. for = 1, 2, . . . , m, 
t=k+i 

n 

n ^J^Wt-Zjtl^O, 

n 

-^K^) 2 -^) 2 ! Ao. (23) 



Now note that 



y/n- kp k 



lb lb It- 

t=k+i v t=fe+i t=jfc+i 

n 

2 



-A; 



t=i t=i 



it, - /(. 

t=i 

Combining ( |22|) and (|23|) yields the result. 

Proof, of Theorem 

By Theorem [T] and equation (jSJ). 

Proof, of Theorem [3] 



□ 



□ 
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Define the empirical copula of the residuals be defines as 



n—m+l 



— E 

- 771+ 1 -f"f 



b=i i=i . 



where (iti, . . . ,u m ) G [0, l] m . Cline and Brockwell (1985) showed 



lim pp\ > t] = £ 

t^oo p\\ZA > t] m 



As a result 



lim raP[|Yi| > a n t] = V \if)j\ a t~ a , 



(24) 



(25) 



for all t > 0, where a n = inf{t : nP[\Z\\ > t] < 1}. Then we can follow the same 
lines of Theorem 3.4 and related technical Lemmas in Bouhaddioui and Ghoudi (2012) 
to prove that the empirical copula of the residuals C m ,n converges to a continuous 
process C if the model ([T|) is correctly identified by MLE method. The continuous 
process C is the limit of the sequential empirical process of a sequence of i.i.d random 
variables identified in Genest and Remillard (2004), for which there is no simple 
expression. However, as in Proposition 2.1 of Genest and Remillard (2004), the 
Mobius transformation of C TOiTl , Ai, leads to some simple results. Let A be a subset 
of {1, . . . , m} with \A\ > 1, the Mobius transformation of C m ^ n indexed by A is 



n—m+l 



M A (C V 



771+1 i A 



u ; 



Then M.A{C m ,n) converge jointly to continuous centered Gaussian processes M.a(C) 
and furthermore Ma{C) and Ai A '(C) are asymptotically independent whenever two 
sets A 7^ A'. Letting A = {l,k + 1}, then the serial rank correlation -y, could be 
derived, as in Bouhaddioui and Ghoudi (2012), from the Mobius transformation of 
C mj „ through 
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li 



J M A (C m ,n)du 



1 r l 



C m , n {ui, 1, . . . , 1, Mfc+i, 1, • • • , l)duidu k+ i 



1 

n 



JO 

n—i 



5> t -l/2)(f m -l/2) 



(26) 



and v^7i is asymptotically normal with mean zero and variance 1/12 2 . The same 
result carries over to the case of the squared residuals as discussed in Bouhaddioui 
and Ghoudi (2012). □ 
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